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Abstract 

The Rasch model and various extentious of this model can be 
formulated as a quasi logl Inear model for the Incomplete subgroup x 
score x Item response 1 x ... x item response k Contlgency table. By 
comparing various logl Inear models, specific deviations of the Rasch 
model can be tested. Parameter estimates can be computed using pro- 
grammes such as GLIM, ECTA and MULTIQUAL, but '.his becomes unpracti- 
cal 1f the number of Items Is large. In that case the tables of ob- 
served and expected counts become too large for computer storage. 

In this paper a method of parameter estimation is described that 
does not require the internal representation cf all observed and 
expected counts but uses only the observed and expected sufficient 
statistics of the parameter estimates which are the marginal taoles 
corresponding to the model terms only. The computational problem 
bolls down to computation of the expected sufficient statistics which 
in its raw form amounts to summation of a very large number of ex- 
pected counts. It is shown, however, that depending on the structure 
of the model, the number of computations can be reduced considerably 
by making use of the distributive law. So that simpler models may be 
computed much more efficiently both in terms of storage and process- 
ing time. 

Keywords: Rasch model, Quasi -Log] inear Model, Incomplete 
Contingency Table, Sufficient Statistics, 
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Contingency table methods (Andersen, 1980; Bishop, Fienberg, & 
Holland, 1975; Fienberg, 1980; Gokhale, & Kullback, 1978; Goodman, 
1978; Haberman, 1978, 1979) have been used to estimate and test 
various psychometric models, Loglinear models — or their multiplica- 
tive equivalent, with or without unobserved variables (Haberman, 
1979) — have been applied to Guttman's (1950) perfect scale model 
(Clogg & Sawyer, 1981; Devisor, 1980; Dayton & Macready, 1980; 
Goodman, 1959, 1975), to models for mastery tests (Macready & Dayton, 
1977; Bergan, Cancel li and Lulten, 1980; van der Linden, 1980), to a 
model of item homogeneity (Lienert, & Raatz, 1981) to Coombs' (1964) 
unfolding model (Davison, 1979), and to the Bradley -Terry model for 
paired comparisons (Fienberg, 1980). 

Mellenbergh, and Vijn (1981) noticed the close similarity between 
the Rasch (1960, 1966) model and a loglinear model for the score x 
item number x Item response contingency table. Vijn and Mellenbergh 
(1982) showed that the parameter estimates of this model are 
identical to Wright and Panchapakesan's (1969) unconditional maximum 
likelihood (UML) estimates of the parameters in the Rasch model. 

Tjur (1982) showed that the conditional Rasch model can be formu- 
lated as a multiplicative Poisson model for an Hem 1 x...x item k 
contingency table, where k is the number of items. For the same 
contingency table, Cressie and Holland (1983) formulated a loglinear 
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Rasch model without conditioning on the sum score. The model Is not a 
standard logllnear model since It includes Interaction terms at every 
possible level. Moreover, because there Is no conditioning on the sum 
score, the distribution of the latent trait must be taken into 
account. To ensure that this distribution exists, complicated 
Inequality constraints must be Imposed on the Interaction terms. 
Kelderman (1984) formulated the conditional Rasch model as a standard 
qua si -logllnear model for the incomplete score x Item 1 x...x Item k 
contingency table. In the sequel of this paper, this table 1$ called 
the "Rasch table". By adding a sum score way to the table, the 
interaction terms vanish a.id the modsl becomes a quasi -independence 
model with main effects for the Item responses only. Using ordinary 
Incomplete-contingency-table methods the conditional Rasch model can 
be estimated and the overall goodness of fit tested. Moreover, the 
model can be tested against 1e r s restrictive quasi -logllnear models 
to detect specific deviations from Rasch homogeneity. 

The general quasi-logllnear model for the Rasch table Is as 
follows. Let X denote the vector of variables (xj,. . . » x k+i)» where 
the first k variables are the responses to dichotomous items, scored 
zero for an Incorrect response and one f'jr a correct response, and 
the k + 1th variable Is the sum score-. Let all the k + 1 possible 
Indices of the variables be collected in tne set U = {l,...,k+l}. 

Furthermore, let , . . . ,A^,. . . ,A & be subsets cf U. Each set A^ 
corresponds to a model term In the quasi loglinear model described 
below. The elements of are the numbers of the variables on which 
these model terms depend. The vector of these variables Is denoted 
as x A I.e. It Is the vector of the variables xj where the variable 



Estimati * Quasi •Logl i near 
4 



numbers j are In the set A^. For example If A^ ■ (1,3,4} 

then x A = (x lf X3, X4). Using this notation, a quasl-logllnear model 

for the Rasch table can be written as: 



(1) 



with constraints 



l u (x ) = 0, 
X.«0 M A I 

J 



for all j * Aj with I - l,.., f s f where x 1 * 0,1;. ..;x k = 0,1; x^ +1 = 
x l + ■•• + x k and where * n * s the nfl tural logarithm and m x Is the 
expected number of individuals in cell x. The u-terms u A ^(x A ^), . .., 
u A (x a ) denote grand mean, main effects and interaction effects of 
the variables x^...^^ like in ordinary ANOVA models. The models 
must conform to the hierarchy principle, that Is, If a u-term occurs 
in the model all lower order relatives must also occur In the model. 

In thi s paper the equivalent multiplicative form of the general 
loglinear model (1) is used: 



(2) \ » * A (* A ) • • - * A (* A ) 



where 



*A (x A ] = explu A (x A ] 
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Kelderman (1984) showed that, If the sumscore variable Is Consid- 
ered a fixed variable, and the item responses as random variables, 
the quasi -independence model (Goodman, 1968), that is, a model with 
main effects only, Is equivalent to the conditional Rasch model. The 
model has Aj 3 *, A 2 * (1} ,. . . >A k+2 ={k+l} so that: 



with the constraints above. The first Item parameter Is set to zero 
to fix the scale (Kelderman, 1984). 

The advantage of using logllnear models for Rasch analysis Is that 
there Is a great flexibility In the testing of Rasch models against 
various alternative quasi logllnear models, and estimating the 
parameters of these models. 

To date, the disadvantage of loglinear models is, however, that 
only a limited number of Items and responses can be analyzed 
simultaneously. The models we work with are defined for an incomplete 
score x item 1 x ... x Item k contingency table. The number of cells 
of this table is the product of the numbers of categories of each of 
the ways. If the number of items or subgroups becomes large, the 
table becomes very large and, for the usual data sets, many of the 
structurally non-zero cells of the observed table will become empty. 

Most present-day computer programs for the analysis of contingency 
tables by loglinear models (Baker & Nelder, 1978; Goodman & Fay, 
1974) require the Internal storage of the observed and expected table 
of counts, which Is virtually Impossible for the present problem. 
However, the tablp need only exist in theory. Firstly, the data can 



(3) 




- u ♦ u 2 (x 2 ) + ... + u k (x k ) + u k+1 (x k+1 ), 



k+1 
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be stored in an ordinary subjects x variables data matrix, which 
avoids storage of structural and nonstructural zero's. Secondly, the 
parameter estimates may be calculated by solving the likelihood 
equations in terms of the set of minimal sufficient statistics. For 
the Rasch model, very efficient algorithms to solve the likelihood 
equations in terms of minimal sufficient marginals have been 
developed by Andersen (1972). Andersen's algorithms can also be 
applied to models that can be broken down into a set of separate 
Rasch models, e.g., models with different item parameters, within 
each subgroup, within each scoregroup, or bot* \'see also Andersen, 
1980a, p. 251). For other models, e.g., models with parameters 
describing Interactions between Item responses the algorithm is of 
limited use. 

Goodman (1964, 1968) describes an algorithm for the analysis of 
incomplete tables by quasi-loglinear models that calculates the 
parameter estimates from sufficient statistics. He uses the 
likelihood equations 



141 V ■ V 

1 1 

for all x. , i = l,...,s, where f denotes the observed marginal 

A 1 X A 
counts for the value x A of variables A,r and m w che corresponding 

l 1 *Aj 

expected marginal counts. 

The parameter $ ( x ) can be derived from (4) by writing fie 
A i A 1 

expected marginal counts in terms of the parameters 



s 0 vv • • • v x a 1 



ERIC 10 



Estimating Quasl-Logl inear 
7 



where A. Is the set of variables not In Aj (I.e. U-Aj). That is, the 

expected marginal counts m x are obtained by summing the expected 

A 1 

marginal cell counts which depend on x = (x A , x^ ) over al] values 
of Xj . Since * A (x A ): does not depend on xj It can be brought 
before summation sign and solved as 



*A (X A ] ' f x 1 J *A (X A ] ' • • *A U A ] 
A 1 A 1 X A 1 x R A l A l A i-1 A 1-l 



1 



%J\J ■ ■ ■ VV 
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which gives the recursion formula: 

(5) » " f « 'I *i r)(x A^"*I r) < X A ' 

A i l X A. Xr a 1 a 1 A i-1 A i-1 

*< r) (x A ) . . . *< r) (x A , 
Vl A 1+l A s A s 

**i r)(x A )(f X ^i^ > 
A 1 A 1 X A 1 X A 1 

where r denotes the Iteration number. This can be used until 
convergence is reached. 

It Is easily shown that (5) is equivalent to the iterative 
proportional fitting algorithm (Bishop, Menberg, & Holland, 1975, p. 
189). Haberman (1974, see Bishop et al v p. 186) gives the conditions 
under which the Iterative propotlonal fitting algorithm converges to 
the unique maximum-likelihood estimates for the expected counts. 

Estimation of the parameters of quasi -iogll near models for the 
Rasch table using (5), does not result In storage problems If the 
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number of Items is large. The number of operations, necessary to 
calculate the expected marginal sums m , however, may still be 
large. We will now reduce this number of operations so that loglinear 
models can be more readily applied to Rasch item analysis. 

Efficient Computation of Expected Marginal Sums 

The marginal table for a set of variables A with values x A is: 

(6) * -I m x =I * (x ) . . . * (x ) 

A Xj Xj 1 1 s s 

with the restriction x k+1 s Xj + ... + x k . 

Using (6) to compute the marginal counts requires a large number 
of operations If the number of items Is not small: for all possible 
values of x^ the product of s model parameters must be calculated and 
the results summed. The number of calculations can be reduced, how- 
ever by using the distribution law of multiplication over summation 
ar.d by avoiding repetition of the same calculations. 

Before describing this method to calculate the expected sufficient 
statistics for an arbitrary loglinear model, its principles are 
Illustrated for a small example. It is shown that the expected sum 
score marginal table of an Item 1 x item 2 x item 3 x sum score table 
can be calculated by repeated multiplication and summation of para- 
meters depending on one item at a time, instead of summing the expec- 
ted counts over all cells. First It is shown that the number of mul- 
tiplications can be reduced by multiplying the parameters depending 
on one Item at a time, Instead of summing the expected counts over 
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all cells. First It 1s shown that the nu&ber of multiplications can 
be reduced by multiplying the parameters depending on the second Item 
with the parameters depending on the first Item and using the result 
In later calculations. Then It Is shown that c .lent summation over 
the first two Items can be accomplished by summing only over the re- 
sult of the previous multiplications. In addition, the third item can 
be processed by multiplying the result of the previous summation with 
the model parameters depending on It.* three, and summing the result 
over Item three. Finally the expected sufficient marginal sums are 
then obtained by multiplying the result with the remaining model 
parameters depending on the sumscore. The restriction x 4 = ♦ x 2 ♦ 
x 3 Is respected, by summing over Item 1 (1 - I, 2, 3) only terms that 
depend on the same sum score t^ « x^ ♦ ... ♦ x^ of the first i items. 

As an example consider the case of three Items and a model with 
^11 main effect parameters and one Interaction effect parameter of 
the third item with the sumscore, I.e., k * 3 and = {1}, ^ s {2} f 
A 3 = l 3 l* A 4 * t 4 ) f A 5 3 ( 3 » 4 )* The multiplicative form of the 
loglinecr model then becomes 

(7) V,x,x. " W *2 (X 2 ) *3 (x 3> *4 ix 4 ) *34 (x 3 X 4 ) 

12 3 4 

with restriction x 4 = xj ♦ x 2 ♦ x 3 . The grand mean effect is left out 
for simplicity. The expected marginal sum for the sumscore variable 
x 4 is: 
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m* ++y . ■ I I I ■ 
'l x 2 x 3 



L L u X«XqX* 

4 x, x 0 12 3 4 



X 4 SX 1 +X 2 +X 3 



-III W *3 ,x 3 ) W *34 (x 34 ) 



x l x 2 x 3 
WY X 3 



tor x 4 s 0, 1, 2, 3. Writing each of these summations In full: 



(8) 



m +++o m m 0000 

m +++l * m 1001 +m 0101 4tn 0011 



m +++2 * '"llOZ^lOU^Om 



+ * 
+ * 



* 34 (00) 

* 34 (on 
* 34 (on 



(0) 4 2 (0) 4 3 (0) 4 4 (0) 

:n « 2 (0) * 3 (o> 4 4 (i) 

(0) 4 2 (1) 4 3 (0) 4 4 (1) 

(0) 4 2 (0) 4 3 (1) 4 4 (1) • 34 (11) 

(1) 4 2 (1) « 3 (0) 4 4 (2) 
(1) 4 2 (0) 4 3 (1) * 4 (2) 

4,(0} * 2 (1) 4 3 (1) 4 4 (2) 



* 34 (02) 

V" 1 



m +++3 " m l 113 



^(1) * 2 (1) « 3 (1) * 4 (3) 



* 34 (12) 
• 34 (13) 



Applying (8), 8 x 4 * 32 multiplications and four additions are 
required to compute the marginal sums. Considering (8) It is seen 
that the four products of parameters (x^ ) and ^(x,,) (x^ = 0,1; 
*2 = 0,1) are each calculated twice. The number of operations can 
therefore be reduced by first calculating the product of the para- 
meters depending on variables one or two: 



(9) 



V 2 (x lt x 2 ) = ^(Xj) * 2 (x 2 ) • 



x l B 0 t l; X2 s 0,1; where the function V 2 Is defined a? the product 
of dll model parameters that depend on the first variable (xj), the 
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second variable (x 2 ) t or both. The function V2 depends on all the 
variables on which one or more of these parameters depend. In this 
case there are two main effect parameters so that V 2 depends only 
on Xj and x 2 . If, however, the model alio contained an Interaction 
parameter for the combination of variables x 2 and X3, V 2 would de- 
pend on variables Xp x 2 and X3. Later, the Vj will be defined more 
generally, but the present definition is consistent with that defi- 
nition. Substituting (9) in (8) yields: 



m +++0 




V 2 (0.0) 


4 3 (0) 


4. 


^(0) 4 34 (00) 


m +++l 




v 2 (i.o) 


* 3 (0) 




<I '34 (01) 




+ 


v 2 (o,i) 


* 3 (0) 


*4 


*34 (01) 




+ 


v 2 (o.o) 


4 3 (1) 


4. 


*34 (11) 


m +++2 




v 2 < J ,1) 


* 3 (0) 


4 


^(2) 4 34 (02) 




+ 


v 2 (i.o) 


4 3 (1) 


4. 


[ lZ) *34 l02) 




+ 


v 2 (o,n 


4 3 (1) 


4. 


\ {Z) *34 (12) 


m +++3 




v 2 (i,i) 


* 3 m 


4. 


\ {2) *34 (13) ' 



Application of Equation 9 and utilizing the result In (10) saves 
four operations. 

Furthermore it is seen that the first and the second term in the 
calculation of in Equation 10 are the same except for the V 

factor. The same is true for the second and the third term in 
m +++2 . Therefore, using the distributive law of multiplication over 
summation, (10) can be rewritten as 



m +++ o = V 2 (0,0) * 3 (0) * 4 (0) * 34 (00) 
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s [V 2 (1,0)+V 2 (0,1)] O 3 (0) * 4 (1) * 34 (on 

+ VJO.O) *-(l) *-(U 

(11) 1 

m +++2 - V 2 (l,l) •j(O) * 4 (2) * 34 (02) 

♦ [V 2 (l f 0)+V 2 (0 f l)] * 3 (1) * 4 (2) * 34 (12) 
m +++3 3 V 2 (l,l) * 3 (1) * 4 (3) * 34 (13) 

This reduces the number of operations required even further. 
Using (11) Instead of (10) saves 2x3 multiplication operations In 
the calculation of and m +++2 . It 1s seen from (11) that the 

same sum of V-terms occurs 1n the calculation of both and 
m +++2 * Consequently, the number of summations can be reduced by one 
by first calculating all sums of V-terms and then applying the 
results In (11). 

In the calculation of m +++1 , the V-terms V 2 (1,0) and V 2 (0,1) 
which are to be summed have in common that the scores of the items 
on which they depend have the same sum score, I.e., 1 + 0 = 1 and 0 
+1=1. This Is caused by the fact that x 3 = 0 in * 3 (x 3 ), t = 1 In 
m +++t and t - + x 2 + x 3 so that xj + x 2 s t-x 3 = t 2 = 1. 

Let $ 2 (t 2 ) be the sum over *he first two variables of the V 2 - 
terms for which the partial sumscore over the first two items is 
equal to t 2 . The index of S denotes that the parameters that depend 
on the first two variables hav£ been processed. This sum becomes 

(t,) 

(12) S 2 (t 2 ) = ) V 2 (x p x 2 ) 

(x^ , x 2 ) 



for Xl . 0,1; x 2 = 0,1; t 2 = 0,1,2; t 2 = Xl + x 2 , where lj^ b) 
means summation of the argument over the possible values of a and 



9 
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b, holding c constant. In (12) this means that for each value of 
the sum t 2 of the first two items, the V-terms are summed over xj 
and x 2 . Written 1n full, Equation 12 gives: 

(13) S 2 {0) - V 2 {0,0) 

S 2 (l) = V 2 {0,1) + V 2 (1,0) 
S 2 {2) = V 2 (l,l) 

It Is seen that there is only one V-term for which the sum score t 2 
of the first two Items is zero. Therefore for t 2 = 0 the sum of V- 
terms over the items x x and x 2 Is only one term: V 2 (0,0). In the 
second equation there are two V-terms for which the sum score t 2 of 
the first two items is one, V 2 (0,1) and V 2 (1,0). Therefore for t 2 ■ 
1 the sum of the V-terms over Xj and x 2 Is the sum of V 2 (O f l) and 
V 2 (1,0). Note that since Xj is equal to t 2 - x 2 , summing over only 
Xj for constant t 2 Is the same as summing over both x^ and x 2 for 
constant t 2 - A general definition of the functions for i ■ 1, 

k is given later. The present definition of $ 2 is consistent 
with that general definition. Substitution of <13) in (11) gives: 



(14) 



$ 2 (0) * 3 (0) * 4 (0) $ 34 (00) 

s 2 (i) * 3 (0) * 4 (i) * 34 (oi) 

♦ S 2 (0) * 3 (1) * 4 (i) * 34 ui) 
S 2 (2) $ 3 (0) * 4 (2) * 34 (02) 

♦ S 2 (l) $ 3 (1) * 4 (2) * 34 (12) 
m +++3 » $ 2 (2) 4> 3 (1) * 4 (3) * 34 (13) 



"+++1 



n +++2 
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In Equation 8 through 14 the calculations for the first two 
Items have been performed and expressed 1n S 2 (t 2 ). The calculations 
Involved a multiplication step (9) and a summation step (12). In 
the multiplication step, for each of the possible combinations of 
responses on the first two variables, the corresponding parameters 
that depend on these two variables are multiplied and assigned to a 
V-term. In the summation step these V -terms were sunroed over the 
values of the first and the second variable, where the partial sum 
score t 2 of the first two items was held constant. By holding the 
partial sum score constant, It is assured that the restriction s 
x l * x 2 * x 3 can be res P ected - Since the first two items are 
processed the restriction becomes 

(15) x 4 - t 2 ♦ x r 

The generic form of Equation 14 becomes 
(t 3 ) 

(16) "♦♦♦x 4 = I , S 2 ( V V x 3> W V'aV - 

4 ( t^ , X^ ) 

fur t 2 = 0, 1, 2; x 3 = 0,1; x 4 = t 3 = t 2 + x 3 . 

In a similar way, the third item can be processed performing a 
multiplication step and a summation step. Finally the sumscore 
variable can be processed by performing a multiplication step. 

The next multiplication step involves the product of the S-term 
and the parameters that depend on item three (see Equation 16). Two 
parameters depend on item three, the main effect parameter ^(x^) 
and the interaction effect parameter ^(x^) for the combination 
of item three and the sum score. The product is then 
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(17) V 3 (t 2 .x 3l x 4 ) ■ S 2 (t 2 ) * 3 (x 3 ) * 34 (x 3 x 4 ) 

for t 2 = 0, 1, 2; x 3 « 0,1; x 4 ■ t 2 + x 3 . 

Where the function V 3 Is defined as the product of the S2-term 
and the model parameters not yet processed that depend the third 
variable (x 3 ). The function V 3 Itself depends on all the variables 
(partial sum score, items, or the sum score) on which one or more 
of these parameters or the S 2 -term depend. In the present model the 
parameters * 3 (x 3 ) and * 34 (x 3 ,x 4 ) depend on variable 3. These para- 
meters and the S 2 (t 2 ) term depend on the variables t 2 , x 3 , and x 4 . 
Substituting (17) in (14) yields: 



* +++ 0 = V 3 (0.0.0) * 4 (0) 

m +++1 = V 3 (1,0,1) * 4 (1) 

+ V.(0,1,1) * A (1) 

(18) J 

m +++2 ■ V 3 (2 t 0.Z) * 4 (2) 

+ V 3 (l,l f 2) * 4 (2) 

m +++3 = V 3 (2,l,3) * 4 (3) 



Applying the distributive law, once more we can rewrite (18) as: 

■♦♦♦o = v°.°.°> v o) 

m +++ , = LV.(1,0,1) + V-(O.l.l) J 4.(1} 

(19) 

m +++2 = [V 3 (2,0.2) ♦ V 3 (1.1.2)] * 4 (2) 
m +++3 = V 3 (2,1.3) * 4 (3) . 

The Vj.terms depend on the scores of the first three items. They 
depend directly on x 3 and indirectly on xj and x 2 v1a tn e partial 



ERIC 1 9 



Estimating Quasi-Logl inear 
16 

sum score t 2 . Note that, due to the interaction parameter * 3 4(x 3 x 4 ) f 
the V-terms In (19) also depend on sum score X4. Obviously the 
values that this total sum score can assume are restricted by the 
value of the partial sum score on which the V-term depends, in this 
case X4 * t 3 . If there were more than three Items, say k f the sum- 
score could assume values larger or equal to t 3 , i.e. t^ < x^ < K. 

As before the summed V 3 -terms in (19) have the same partial sum 
score for the first three Items, because t 2 + x 3 * t 3 is the same 
in each term. The sums in (19) can be replaced by: 

(tj 

(20) S 3 (t 3> x 4 ) - j * V 3 (t 2 ,x 3 ,x 4 ) , 

for t 2 * 0,1,2; x 3 = 0,1; x 4 * t 3 » t 2 + x 3 . The Index of S 3 de- 
notes that the parameters that depend on the first three variables 
have been processed. For each t 3 this sum becomes 

3(0,0.0) 

3(1,0,1) + V 3 (0,1,1) 

3(2,0,2) + ¥3(1.1.2) 
3(2,1,3) 



S 3 (0,0) * 4 (0) 

S 3 (l,l) » 4 (1) 

S-'2,2) * 4 (2) 

Sj,3,3) * 4 (3) • 



(21) 



so that 



(22) 



S 3 (0,0) = V 

S 3 (1,D = V 

S 3 (2,2) » V 

S 3 (3,3) = V 



m +++0 ■ 



m +++l = 
m +++2 = 
m +++3 = 
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The expected marginal sums can now be obtained by performing one 
more multiplication step for the sumscore variable, 

(23) V 4 (t 3 ,x 4 ) = VW * (x 4 ) » 

t 3 ■ 0, 1, 2, 3; = t 3 , where the function is defined as the 
product of the S^-term and the model parameters not yet processed. 
The function V4 itself depends on all the variables (partial sum 
score, items, or the sum score) on which one or more of these 
parameters or the S3 term depend. Substituting (23) in (22) 

m +++0 = V 4 (0,0) 

m +++ i " Va(1»1) 

(24) 

m +++2 = V^(2,2) 

m +++3 3 v 4 (3 » 3 > 

the expected marginal sums are obtained. 

In this example, a small number of items and a simple model was 
chosen for the example. In practice there will usually be many more 
Items and the model may contain Interactions of all orders. In what 
follows, this marginal ization by variable algorithm is described 
for arbitrary number of Items and an arbitrary quasi -logllnear 
model . 
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The Marginal1zat1on-By-Var1able Algorithm 

In this section, the Marglnallzatlon-By-Varlable (MBV) algorithm 

Is described for an arbitrary model (2), where the model terms 

(x. ), *a (** 1 *a (*a ) are Interaction 

A l A l A j A j A s A s 

effects of the variables whose Indices are In the sets A lt ...,Aj, 

. ..,A C . In the model term *. (x. ), the vector x A refers to a 

s A j A j *J 

generic value of the vector of variables whose Indices are In Aj. 

Thus each model term corresponds to a set of parameters with 

specific values of x A ^. For convenience, we wiil refer to a model 

term*, (x. ) by the Index j of the set Ai that characterizes that 

A j A j J 
model term. 

To estimate the model parameters using the Iterative proportio- 
nal fitting algorithm (5), expected sufficient marginal counts m- , 

A l 

. m , m- must be calculated. The calculation of one 

\ A s 

expected marginal table m Is described. To obtain this table, 

A 

i 

summations must be performed over all possible values of the 
remaining variable indices not in A^. 

Although A * may be every subset of variable indices, for 
simplicity of exposition, it is assumed that A^ contains the indi- 
ces of the first v (<k) variables, i.e. = ( v+1, . . . ,k+l) . This 
presents no loss of generality since the original set of items can 
be renumbered arbitrarily to fit this representation. Moreover, all 
tables that do not depend on the sum-score variable can be obtained 

by summing m over the sum-score variable. 
*A 



Just as in the example above, the expected marginal table m_ 



Is obtained by repeated multiplications (c.f. (9) and (17)) and 
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summation (c.f. (12) and (20)) of the parameters that depend on one 

the variable at a time. The result is multiplied by the remaining 

parameter (cf. (23)). 

To obtain m w , 2v ♦ 1 steps are needed 1n the Algorithm below: 
A 

2v steps for multiplication and summation of the parameters 
corresponding to the first v items and one more step to multlpy the 
result with the remaining parameters to obtain the marginal table. 
An optional summation has to be added if the marginal table may not 
depend on the sum score. 

Six steps are described: step 1, 2, 3, 4, 21-1, (21), and 
(2v+l). The odd numbered steps Involve multiplication operations 
while the even numbered steps involve summation operations. Step 1 
and 3 correspond to multiplication of the model terms depending on 
variables 1 and 2 respectively. The summation in step 2 does not 
have any effect but Is added for later reference. Therefore, the 
result of step 1, 2, and 3 correspond to multlpllatlon of the model 
terms depending on variable 1 and 2. In the example above, these 
first three steps are summarized in Formula (9). 

Step 1 

Multiply the parameters depending on variable Xp Let Lj be the 
set of model terms j (<{l s}) dependlnq on variable 1 and let 

be the set of indices of the variables on which these model 
terms depend. Then, the product is obtained: 



(25) VW, VV' 

1 j j 
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for all possible values that the vector Xq^ can assume. If 
x b (b c Bj) is an Item (b < k) It can assume values x = 0, 1. All 
combinations of Item responses can occur. If x b 1s the sum-score 
variable {b ■ k + 1) then the values 1t can assume depend on the 
values of the item responses: 

Vl * tl **. ] ' k " (#(B) * t( V n 

where t(x^) is the sum score of the items in the vector x^ and 
the function #(X) yields the number of elements of a set X. The 
formula shows that the sum score variable cannot be smaller than 
the sum scores of the items of vector Xg. Also, 1t cannot be larger 
than the total number of items minus the njmber of wrong responses 
(#(B) - ttx^)) of the items in the vector x^. 

Note that since the sets Aj (j t L^) are subsets of Bj, the 
values of x Aj U « Lj) are known if the value x^ 1s known. 

Step 2 

Sum the result of step 1 over variable xj holding the sum score 
t^ constant, where t^ was defined as xj + ... + x^ (the sum of the 
first i item responses). Since In this step tj and x l are st111 
equal, in fact no summations are performed. However for later 
reference the following sum is defined 

(26) wv 5 iu|>vv 

for all possible values of tj an d k^, where tj = xj and 
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Ci 5 Bi - ll} is the set of subscripts of the variables on which S 
depends. 

The sum score t} can assume values 0 and 1 since it is equal to 
Xp The items in Xq^ can each assume the values 0 and 1. If x^^ 
also contains the sum-score variable the latter assumes the 

values 

Vi * (t i n(x c 1 )) (t i n(x c 1 ) + (k • 1 - # < c i )))f 

that is, the total sum score x k+1 cannot be smaller than the sum 

score ti of the first item plus the sum score of the items in 

vector v • Also it cannot be larger than this value plus the 
M 

maximum score that the remaining items, not in Cj nor used in t 1# 
can assume. 

Step 3 

Multiply the result of step 2 with the model terms that depend 
on variable X2 but are not used in step one, i.e. that are not in 

L r Let L 2 be the set of these mo(le1 terms ^ e {!•••••*}) an(1 1 et 

B2 be the set of indices on which these parameters or the result 
of Uep 2 depend. Then this product is defined as 

(27) vvv 5S i ( vV" W 

for all possible values of tj an( j ^ Note that s1nce the sets Aj 

(j c L 2 ) c i are subsets of B 2 , the values of x A (J c l_ 2 ) and 
He are known If the value to is known. The values that tj and Xg 
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can assume are defined analogously to those in step 2 with C} 
replaced by 82- 

Step 4 

Sum the result of step 3 over tj and x 2 holding the sum score 
t2 • + x 2 - tj ♦ x 2 constant. This sum Is 

(28) S 2 (t 2 .^) 5 yt^) 

for all possible values of t 2 and Xg and where C 2 = B 2 - {2}. The 
values that t 2 and «q can take are defined analogously to those of 
t| and x^ In step 21 (see below). 

Steps similar to step 3 and 4 are performed for the remaining 

v*. lables X3 Xj x y over which one has to sum. In 

general these steps are as follows. 

Step (21-1) 

Multiply the result of the previous step with the model terms 
depending on variable i that are not used in the one of the 
previous steps, I.e., the model terms j ( r - (1, s}) that are 

not in Lj.j. Let Lj be the set of these parameters and let 

Bj be the set of indices on which these parameters or the result of 
the previous step depend. This step yields the product. 

(29) VVrY )5 Vi'Vi^ > n * (x A ) 
for all possible values of t M an( j ^ § where 
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^1-1 5 B i-i " l** 1 )* The values that t^.j and x^ can assume are 
d^lned analogously to the values of t i and xq^ In step 21. 

S^*n 21_ 

Sum the result of the previous step over t^.j and x i holding 
constant the sumscore tj ■ Xj + ... + ■ t^.j + This step 
yields the sum 

(30) VVV 1 ft . I v*m«v 

for all possible values of tj and Xq^, where = - {1}. 

The sum score tj ■ Xj + ... + x^ can assume values 0 through 1 
since each of the Items xp •••• Xj can take the values 0 or 1. 
Also, each of the Items In Xq. can assume the values 0 and 1. Note 
that none of the Items in Xq^ Is used to calculate t,* since Is 
the vector of item responses on which Sj depends after summation 
over the first 1 variables. If x^ also contains the sum score 
variable x k+1 , It assumes the values 

(31) x R+1 = (t. ♦ t(^)) 

(t. + ttxj. ) + (k - i - #(0^)), 

that is, the total sum score x k+1 In x^, cannot be smaller than 
the sum score tj of the first 1 Items plus the sum score t(x^) of 
the Items in the vector j^. Also, It cannot become larger than 
this value plus the maximum sum score that the remaining items, 
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I.e. the Items not In x^. nor used to calculate tj, can attain. 
Step 2v+l 

Tr calculate the expected marginal sums m tf In (6) that depend 

on the variables « {(v+1) (k+l)} t the S*-term resulting from 

the previous step Is multiplied by the model terms that have not 
been used In the previous steps, I.e. the model terms that are not 
In Ly» Let 

L v+1 be the set of these mode1 terms then 
the expected marginal sums are 



(32) 



«L 9 S (t ,x, ) n * A U. ) 
\ v v jcL y+1 A J A j 



for all possible values of x. . Note that the sets 

Aj (j < L y+1 ) correspond to mooel terms that have not been used 

earlier. Consequently, they cannot contain any of the variables 

1 v. Therefore, Aj (j € L^) are subsets of » {v+l,...,k+l}. 

Similarly since S y Is obtained by summation over the variables 

1 v the result cannot depend on Xj x ¥ . Therefore C v Is 

also a subset of A^ * {v+l,...,k+l}* 

Furthermore, since the model contains a main effect for each 

variable, each variable index (v+1) (k+1) occurs at. least In 

one of the sets Aj (j e L y+1 ). Because of this and the observation 
above we have 



A * ti A = {v+l,...,k+l} 
J L v+1 

The variables in (32) are related in the following way. since the 
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sets C v and Aj (J c L y+1 ) are subsets of A^ the values of 

x Aj ^ c L v+1* and *C V dre conta * ned * n X A ' purthermore » the sum 

score variable x k+1 In the vector x^ Is related to t y and the 

values X£ for each of the model terms j e l y+ ^ by the relation. 



where x y+ p...,x k can each take the values 0 or 1. 

Numbers of Calculations In the MBV -algorithm 

The MBV-algori thm was developed to reduce rhe number of opera- 
tions necessary to calculate the expected sufficient marginal 
tables that must be used in the Iterative proportional fitting 
algorithm (5). We will compare the number of calculations using the 
MBV-algori thm with the number of calculations that would have been 
necessary if all the expected cell frequencies had been summed to 
obtain the expected sufficient marginals. The comparison Is done 
only for the quasi -Independence model, I.e., the model containing 
main effect parameters onl . ;~*hermore it is assumed that all 
Input variables are dichotomously scored Items. 

Summing over all cells requires calculation of each expected 
cell frequency. One expected cell frequency Involves the 
multiplication of the general mean parameter with k Item parameters 
and one sum score parameter, I.e. k+1 multiplications. There are a 
total of 2* cells In the table, hence 



PS 



ERIC 



Estimating Quasi -Logllntar 
26 



(33) (k + l)2 k 

multiplications have to be performed. 

The expected marginal table for the responses on one Item has 
two possible cells, so 

(34) 2 k - 2 

summations are necessary to obtain this table from the 2* cell 
counts. Likewise, for the sum score marginal table, this number 1s 

(35) 2* - (k + 1) 

since the sumscore has k + 1 possible values. In Table 1 the 
numbers of multiplications and summations are given for tests of 
different lengths. Obviously, If the number of Items Is large, this 
method is not feasible. 

In the MBV algorithm the number of cakulatlons to obtain tie 
sumscore marginal is as follows. In the multiplication step (29) 
each of the specific values of elements of the codomaln of Is 
obtained by multiplying an element of the S-term with each of the 
parameters whose Index Is In Lj. If there are only main effects In 
the model, Lj has only one element: The number of the main effect 
term for variable 1. So only one multiplication is needed for each 
element of Vj. The number of elements In V i Is equal to the product 
of the number of values that the partial sumscore tj.j can assume 
and the number of values that the item responses Xg can assume. 
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Because we consider a m\„ effects model B 1 * {1}, and hence x^ Is 
equal to (xj). The number of possible values of t^ Is 1 and the 
number of values of x 1 is 2. Consequently one multiplication step 
Involves 21 multiplications. 

In the sunmation step, the S-term Is obtained by summing certain 
elt^nts of over x 1 and t^j. In this case S 1 depends on tj 
which can assume 1 + 1 values. Therefore to obtain S from V f (21) - 
(1 + 1) a 1 - 1 summations are necessary. 

To obtain the marginal table for the sumscore variable a 
multiplication and a summation step must be performed for each of 
the k items. Note that in the first step there is no S-term and 
only one (main effect) parameter. Hence this step does not involve 
multiplication. Therefore, multiplication starts at the third step. 
In addition, each of the (k + 1) values of the last S term has to 
be multiplied with the sumscore parameter and the grand mean 
parameter. The number of the multiplications is therefore 

k k 
(36) I 21 + 2(k + 1) = 2^1 + 2k 

1=2 1=1 

= k(k + 1) + 2k 
» k(k + 3) 

There are summation steps for each of the k items, therefore the 
number of summations is 
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(37) I (1 - 1) « (k \ 1)k - k 
1=1 C 

m k(k - 1) 
2 — 

It can be seen from Table 1 that the number of multiplications 
and summations In the MBV algorithm remains within reasonable 
limits and Is less than In the case of summing over all cells. 

For an arbitrary model Aj,...,A s for k dlchotomous Items, the 
number of multiplications and summations are more difficult to 
calculate. Suppose *ga1n that marginal Izatlon has to be performed 
over the all observed variables. One multiplication step Involves 

(38) a t #(Lj) 9 

1 ■ 2,...,k, multiplications where 

(39) a t - #({V,U Mi ^ ))) 

Is the number of elements of and #(L.) is the number of para- 
meters to be multiplied with the preceding sum for each element of 

The first step does not involve an S term so that it involves 
a^(#L^-l) multiplications. After k steps the S term depends only on 
x 4 and the marginal table can be obtained by multiplying each of 
its k ♦ 1 elements with the sum score parameter and the grand mean, 
which gives 2(k + 1) multiplications. The total number of 
multiplications then becomes 
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k 

(40) I #(L)a. - a. + 2<k + 1) 
1=1 1 1 1 

The number of summations In each step Is 

(41) af - 
where 



(42) bj = fUS^t^ )}) 



I.e. the number of specific values of S^. The total number of 
summations becomes 

k 

(43) I (a. - b.) 

1=1 1 1 

The numbers a 1 and b^ depend on the specification of the model. 

The number a i of elements of V^I-r^B ' 1s the P r0<luct of tte 
number of partial sumscores t^j and the number of values of Xj^. 
The number of partial sumscores tj_j Is equal to i. The number of 
values of Is the proJuct of the number of values that the Items 
whose numbers are in B 1 can jintly assume and the number of values 
that the sumscore can assume. If Its number 1s In Bj. 
The Items whose numbers are In B { can Jo1ntly assume 



(44) 2 



#(B r {k+l}) 
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values. If the number of the sum score variable Is present In Bj, 
I.e. #({k+l} n Dj) a 1, the number of values that the sumscore 
variable can asssume Is equal to 



(45) 1 ♦ k - #(B^ ). 



Thus, the number elements of becomes 

m r (k ♦ 1}) #({k ♦ 1} n BJ 

(46) 3^2 1 (l*lt-#(B) 1 



The S-term Is obtained from the V-term by summing the elements 
with the same partial sumscore t i over the two values of Item 1. 
Consequently the number of values that the partial sumscore can 
assume becomes 1 + 1 rather than 1 and the number of values that 
can assume Is half the number of values of Xq^, hence 

The number of summations using the MBV algorithm thus becomes 

(47) ^(1-11^1=2 a l C i 1) 

1*1 1 ^ i*i 1 L 1 

In contrast, if the marginal table for the sumscore varlabele Is 
calculated by summing all cell frequencies, the number of summa- 
tions Is equal to the number of cells of the full table minus the 
number of cells of the marginal table. 
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(48) 



2 k - (k + 1). 



and the number of multiplications 1s equal to 



(49) 



Z*(s - 1), 



which 1s the product of the number of cells of the full table and 
the number of parameters minus one. 

It 1s seen from Formula (46) and (47) that the number of 



This number, In turn, depends on the number of variables that 
variable 1 Interacts with. The number of simulations (48) In the 
summing over all cells algorithm, however, will always depend 
exponentially on the number of Items k. 

Comparing the number of summations (47) In the MBV algorithm 
with the number of summations (48) needed when summing over all 
cells, 1t can be shown that the former Is smaller or equal to the 
latter. Equality occurs If the model Is the saturated model (see 
Appendix I). 



To estimate quasi -logllnear models for the Rasch model when the 
number ~* Items Is large, the computer program GELORA (Generalized 
Logllnear Rasch Modelling) was written. GELORA Is a Pascal program 
that calculates the parameter estimates using the methods described 
above. 



summations depends exponentially on the number of variables 1n Bj t 



Application of the MBV Algorithm 
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To evaluate the applicability of the algorithms, test data 
conforming to the Rasch model where generated for 20 Items. The 
Item difficulties where randomly chosen from the uniform distribut- 
ion over the Interval [-2,2 J. Latent trait values for 10,000 cases 
were drawn from a uniform distribution over the [-3,3] Interval. 

Logllnear Rasch models were then fitted to these data. Seventeen 
computer runs were made for different subsets of Hems, where the 
first subset contained the first four Items, the second subset con* 
talned the first six Items etcetera. 

In Table 2 the numbers of Iterations, the mean CPU time per 
Iteration, the CPU time needed for Input amd Initialization, and 
the total CPU time of the problem run are shown. Iterations were 
performed until none of the parameter estimates could be Improved 
by more than .005. A VAX 8750 computer was u?ed. From Table 2 It Is 
seen that the number of Iterations and the mean CPU times per 
Iteration do not Increase dramatically compared to the number of 
Items In the test. 

In Table 3 the real Item difficulties and the estimated Item 
difficulties values of all 20 Items are given. The item parameter 
estimates were obtained by the GEL0RA program and by the PML 
(Gustaffson, 1977) program. PML calculates the CML estimates of the 
Item parameters with Andersen's (1972) method. In both cases the 
first Item difficulty parameter was set equal to Its real value. 
Furthermore, the Iterations were stopped until none of the 
parameter estimates could be Improved by more than .0001. It can be 
seen from Table 3 that both solutions are Identical up to the 
second decimal place. 
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The algorithm was also used with simulated Rasch data for 40 
Items. With 40 Items the solution was reached after 29 Iterations. 
Each Iteration took approxtnately 155 CPU seconds. This shows that 
maximum likelihood estimates 1n quasi -logll near Rasch models can be 
obtained for practical numbers of Items, 

Conclusion 

In this paper an algorithm 1s presented that calculates the 
parameter of quasl-logllnear models for the Rasch tabel from the 
expected sufficient statistics by an efficient method. The method 
1s Implemented 1n the program GELORA. The progam facilitates the 
application of Rasch Hem analysis by quasi -logll near models. 
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Appendix I 

In the case of the saturated model 0 1 ■ {1,...,k+l} so that 
Formula 46: 

•f - 12 (k " 1 + l) 

The number of summations , Formula (47), Is: 



I 12 k - 1 (1 - h 
1=1 1 



THEOREM 

For all Integers k > 1 , 



\ 12 k ' *(1 - j) « 2 k - (k + 1). 
1-1 1 



Proof (by Induction): For k • 1, the theorem Is true because both 
sides reduce to zero. 

The Induction hypothesis is that for r > 1 



[ 12 r _ Ul - j) = 2 r - (r + li 
i=l 1 



Hence 

r+1 



1-1 1 
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2 I 12 r_1 U-f) 
1«1 1 



2^Ul2 r " '(1 - \)} * Zir * I) 2" 1 (1 - 



■ 2(2 r - (r + D) + r » 2 r + 1 - ((r + 1) + 1) 



which proves the theorem for k ■ r + 1. 
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Table 1 

Nuibers of Multiplications and Suwnatlons Required by Suwnlng over 
all cells and the MBY Method to Calculate the Suwscore Marginal 



Number of 
Items 


Summing all cells 




HBV Method 


X 


+ 


X 


♦ 


5 


192 


26 


40 


10 


6 


448 


57 


54 


15 


7 


1024 


120 


70 


21 


8 


2304 


247 


88 


28 


9 


ci 9n 


SO? 


108 


36 


10 


11264 


1013 


130 


45 


11 


24576 


2036 


154 


55 


12 


53248 


4083 


180 


66 


13 


114688 


8178 


208 


78 


14 


245760 


16369 


238 


91 


15 


524288 


32752 


TO 


105 


16 


1114112 


65519 


304 


120 


17 


2359296 


131054 


340 


136 


18 


4980736 


262125 


378 


153 


19 


10485760 


524268 


418 


171 


20 


22020096 


1048555 


460 


190 




40 
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Table 2 

Numbers of Iterations and Mean CPU Times for In Estimating 
Rasch models with GELORA. 



Number of Number of CPU Til 
Items Iterations 



Per Input Total 

Iteration and 

Initialisation 



4 


7 


0.3 


10.0 


12 


6 


8 


0.7 


14.3 


20 


8 


8 


1.5 


18.5 


31 


10 


9 


2.6 


24.7 


46 


12 


10 


4.3 


32.4 


71 


14 


il 


6.6 


39.0 


105 


16 


11 


9.5 


48.2 


153 


18 


12 


14.2 


58.0 


228 


20 


13 


18.8 


68.7 


304 
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Table 3 

Real and Estimated Item Difficulties for Simulated Data 



Item 




1 




3 


4 


5 


Real 

GELORA 

PML 


.858 

.858* 

.858* 


-1.512 
-1.517 
-1.517 


-0.173 
-0.214 
-0.215 


-1.040 
-1.069 
-1.069 


1.137 
1.161 
1.161 




6 


7 


8 


9 


10 


Real 

GELHA 
PML 


1.354 
1.318 
1.318 


1.690 
1.636 
1.636 


0.577 
0.618 
0.618 


-1.270 
-1.350 
-1.349 


-0.155 
-0.154 
-0.153 




11 


12 


13 


14 


15 


Real 

GELORA 

PML 


1.302 
1.243 
1.244 


1.352 
1.282 
1.284 


-0.823 
-0.858 
-0.857 


-0.883 
0.871 
0.871 


-1.754 
-1.801 
-1.801 




16 


17 


18 


19 


20 


Real 

GELORA 

PML 


-0.026 

-o.o:e 

-0.03d 


0.221 
0.183 
0.183 


0.517 
0.502 
0.502 


-0.460 
-0.506 
-0.507 


1.658 
1.654 
1.653 



*) The estimated parameter of the first Item was set equal to the 



real parameter to fix che scale 
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